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j ABSTRACT 
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Work concerned with the statistical evaluation of the output of the MEDICO automatic indexing 
method is described. The statistical tests were designed primarily to examine the validity of the 
assumptions which formed the bases of the algorithms developed for the automatic computation of 
weights and for the automatic generation of links between index terms and modifiers. Evaluation also 
included a comparison of the output generated from full text and from the processing of the abstracts 
or summaries of the same articles. 
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I. STATUS OF THE PROJECT 

Phase I of the Project concerned with the development of the automatic indexing method was 
completed and described in the First Progress Report published in January 1968. ■ 

This Second Progress Report describes work related to the statistical evaluation of the output 

j 

of the automatic indexing method which was developed in Phase I. 

j 

Preparation of the search program for the automatically generated index file is near completion j 

and will be described in the next report. This third report will also include the results of searches 
in response to queries. 
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II. SUMMARY 

This is the Second Progress Report on research in the automatic indexing of drug information 
conducted at Rutgers University under grant LM-9U from the Public Health Service National Library of 
Medic ine . 

The report describes work concerned with the statistical evaluation of the output of the auto- 
matic indexing method which was developed and implemented in Phase I of the Project.'' The method will 
generate index tags automatically from natural language text and by utilizing explicitly defined text 
characteristics it creates a machine searchable file of index records for the documents being processed. 

The statistical tests were designed to examine the validity of the assumptions which formed the 
bases of the indexing algorithms with primary emphasis on the algorithms developed for the computation 
of weights and for the generation of links between index terms and modifiers. 

The articles included in the test were scanned by a human indexer to check the correctness of 
the weights appearing in the output of the automatic indexing program. The links were similarly checked 
to determine whether they were correct in the context of the sentence. 

The statistical evaluation for weights and links gave the following results: A comparison of 

the weights assigned to terms using the MEDICO and manual procedures gave the same value for 1 \% of the 
terms generated by either procedure. A moderate increase in agreement (78$) was observed when only 
terms having a weight of 3 by at least one of the methods were considered. Ninety-eight percent of the 
weights assigned by the two methods were found to be either in agreement or to differ by a weight of 1. 
These findings seem to indicate that the effectiveness of the method of weighting could be improved by 
allowing only two weights in the system. 

Seventy-two percent of the links generated between index terms and modifiers by a full text 
scan of the articles by the MEDICO procedure were relevant. While writing style does not appear to have 
an effect on the proportion of agreements on weights for the MEDICO and the manual method, the percentage 
of relevant links observed was found to be dependent on the author's writing style. The proportion of 
relevant links decreased as the average length of the sentences increased. When the definition of a 
link was changed from co-occurrence within a sentence to co-occurrence between two punctuation marks, 
the percentage of relevant links increased to 81$ for the articles studied. 

*Artandi, Susan and Stanley Baxendale. Project MEDICO. First Progress Report. New Brunswick, 
N.J., Graduate School of Library Service, Rutgers, the State University, January 1968. 
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Evaluation also included a comparison of the output generated from full text scanning and from 
the processing of the abstracts or summaries of the same articles. This comparison was considered 
important because of the difference in cost involved between full text and reduced text processing. 

The data resulting from the statistical evaluation should give some indication of the improvement in 
output that can be expected as a result of the additional expense involved in full text processing. 

No significant difference was found in the performance of the two forms of reduced text, 
abstracts and summaries. 

A comparison of the index terms generated from full text with those which were generated from 
reduced text showed that the proportion of terms indexed from reduced text is greater for those terms 
which had high weights in the full text analysis. Eighty-six percent of terms having a weight of 3> 
k6% of the terms having a weight of 2, and 11^ of the terms having a weight of 1 in the full text 
analysis were also generated fran reduced text. 



III. STATISTICAL EVALUATION OF THE EFFECTIVENESS OF AUTOMATICALLY 

GENERATED WEIGHTS AND LINKS 



Introduction 

In his study of iiriex language Cleverdon suggests that indexing systems are made up of a basic 

vocabulaiy an3 a number of devices. These index language devices are of two kinds; 1) recall devices 

which are intended to increase the probability of retrieving a larger number of relevant documents, and 

1 

2) precision devices which are intended to ensure that non-relevant documents are not retrieved. 
Coordination, weights, roles, and links are precision devices, all of which have the effect of increas- 
ing the specificity of index terms or search terms. While these particular devices are frequently 

p 

associated with post-coordinate systems, they are by no means limited to such systems. 

t 

Weighting means the assignment to a xem a value representing the relative significance of that 
term in the total subject description of the document or in the query. Thus, a term which represents a 
central theme gets a high weighting and one which represents only a marginal element in the subject gets 
a low weighting. Links indicate particular connection between terms where the lack of such a link might 
create ambiguity. 

Research related to the use of these devices has been largely centered around systems in which 
the indexing of documents was done by humans. The research described in this paper developed a method 
for the automatic generation of weights and links as part of an automatic indexing method. In automatic 
indexing the computer assigns index terms directly from the natural language text of the document 
applying the same algorithm for each document. In human indexing the indexer makes a separate judgment 
for each document. 

The automatic indexing method which was developed in Project MEDICO^ will generate an index tag 
automatically from natural language text. The group of documents used in the Project are English 
language periodical articles published in the medical literature. In their indexing the emphasis was on 
drug-related information because of the extensive needs which exist in the drug information area. 

The computer scans the text of documents and by utilizing explicitly defined text characteristics 
it creates an index record for each document containing the following elements; 

Author 

Title 

Bibliographic citation 

Index terms without modifiers with their respective weights and Chemical Abstracts 
Registry Numbers 

5 
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Index terms with modifiers with their respective weights 
Figure 1 shows a sample printout of the output of the automatic indexing program. 

The file of these index records can be searched on a coordinate basis. The use of the Boolean 
connectives AND, OR, and NOT, enables the system to answer search questions requiring the presence or 
absence of several parameters in specific combinations. 

To indicate the relative importance of various index tags in the document description, the pro- 
gram automatically assigns a weight to each index term. To indicate the context in which the drug teim 
is used in the document, the indexing program automatically links drag terms with modifying terms. 

The algorithm developed for the computation of weights is based on the assumption that the 
relative frequency of occurrence of terms in the text can serve as an indication of the importance of 
the subjects they represent. This assumption can be traced back to early experimental work of H, P. 

Luhn^ followed by others^ who developed various indexing methods based on the frequency of terms in the 
text. In the method which is described here, relative rather than absolute frequency was used in the 
computation of weights to compensate for differences in length among articles. The compuoer calculates 
the number of occurrences per thousand text words and converts the resulting figure into a weight in the 
following manner: If the frequency of the term per thousand text words is less than or equal to 1, the 

document is assigned a weight of 1. If the frequency of the term per thousand words is greater than 1 
and less than 3, the term is assigned a weight of 2. Finally, if the frequency of the term per thousand 
words is greater than or equal to 3, a weight of 3 is assigned to it. 

The automatic generation of links is based on the assumption that co-occurrence within a sentence 
is a satisfactory indication that the terms belong together within the context of the document. Because 
the test documents were medical articles and because emphasis in the indexing was on drug-related 
information links were created primarily between the names of drugs or chemicals and terms which could 
act as modifiers. Therapy, activity, effect, administration, are examples of modifiers. 

The following are exanples of sentences from which valid links between drug names and modifiers 
were automatically generated. 

"In the review of English literature of the past ten years the author has found no other 
reference to the occurrence of hyperglycemia following the administration of diphenylhydatoin in 
humans." 

"It was therefore estimated that he received a total do sage of at least 800 mg. of diphenyl - 
hydantoin in a 21; hour period or approximately 70 to 80 mg. per kilogram." 

The first sentence generated the index tern diphenylhydatoin/ administration and the second 
generated the term diphenylhydatoin/administrat ion . 

The statistical evaluation described in this report was intended to shed light on the validity 
of the assumptions just discussed. In the case of links it should also show the significance of linear 
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BUCHANAN OS 

AN APPROACH TC MANAGEMENT OF STATUS EPILEPTICUS. 

SOUTHWEST MED 47,187-9, JUL 66 

NO. OF WORDS = 1760 
(2) BARBITURATES 

57432 (2) AMOBARBITAL, 5-ETHYL-5- ISOAMYLBARB I TUR I C ACID, BARBITURATES, 
AMYTAL 

50066 (3) 5-ETHYL-5-PHENYLBARE ITURI C ACID, PHENCBARBI TAL, BARBITURATES 
(2) ANTICONVULSANTS 

57410 (3) DIPHENYLHYDANTOIN, 5 , 5-CI PHENYL-2 , 4-1 MI DAZOL I DI NEDI ONE , 
HYDANTCINS 



AMYTAL/ THERAPY (1) 

AMOBARBITAL/ THERAPY (1) 

PHENOBARBITAL/ ADMINISTRATION (1), EFFECT (1), THERAPY (2) 
ANTICONVULSANTS/ EPILEPSY (1), THERAPY (1) 
DIPHENYLHYDANTOIN/ DOSAGE (2) 

BARBITURATES/ ACTIVITY (1) 



END OF ARTICLE 
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distance within a sentence between index terns and modifiers or the role of intervening textwords. 

Fifteen articles were selected for the test. The articles were scanned by a human indexer to 
check the correctness of the weights appearing in the output of the automatic indexing program when 
human judgment rather than an automatic method is used. The links in the output were checked to deter 
mine whether they were correct in the context of the sentence. The manual work was done by a single 
individual and no attempt was made to determine the variability associated with different individuals 

checking the same article. 



Weights 

As was already indicated, the algorithm for the automatic assignment of weights utilizes text 
characteristics on the basis of purely quantitative criteria. The manual checking of weights involved 
some subjectivity on the part of the evaluator. A weight of 3 was judged correct for a tern which in 
the opinion of the evaluator is central to the theme of the article, a weight of 2 for a subject of minor 
importance, and a weight of 1 vdien the subject was considered incidental to the theme of the article. 

On the basis of this the number of agreements and disagreements was recorded for each document. The 
automatic and the manual methods were said to agree when both assigned the same weight to a particular 
index tern. 

The results are summarized in Table 1. 



Table 1: Agreements and Disagreements for Each Article 



Article 


Agreements 


Disagreements 


Total 


1 


8 


1 


9 


2 


3 


3 


6 


3 


28 


13 


Ul 


k 


5 


2 


7 


5 


12 


1 


13 


6 


7 


k 


11 


7 


3 


1 


k 


8 


1U 


3 


17 


9 


li 


3 


1U 


10 


h 


2 


6 


11 


22 


10 


32 


12 


3 


3 


6 


13 


7 


7 


lU 


lU 


5 


2 


7 


15 


6 


1 


7 


Totals 


138 


56 


19U 
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A y® test to test the hypothesis that the proportion of agreement between the two methods is 
unaffected by writing style (the observed difference in the proportion of agreements is due purely to 
chance) yielded a value of 12.66. The critical y® value with a risk of 0.10 and degrees of freedom lU 
is 21.06. Since the observed value is less than the critical value we accept the hypothesis that the 
differences in the observed proportion of agreements is due to chance. 

We now consider the fifteen articles collectively. Classify each tern or link on the basis of 
the weights assigned by the two methods. For example, the MEDICO procedure might have given a particular 
term a weight of 3, while the manual method classified the tern as weight 2. Thus we have the classifi- 
cation (3,2) for the particular tern. The total number of such classifications is 15 since each method 
can yield a wei$it of 0, 1, 2, or 3. The classification (0,0) is not possible because we are considering 
only those terns which are assigned by at least one of the two methods compared. Table 2 summarizes the 
frequencies observed in the form of a two-way table. 

Table 2: Comparison of Weights Assigned by the Two Procedures 



Manual 

Evaluation 












MEDICO 

Evaluation 


0 


1 


2 


3 


Totals 


0 




18 


0 


0 


18 


1 


1U 


79 


8 


0 


101 


2 


2 


6 


31 


6 


U5 


3 


2 


0 


0 


28 


30 


Totals 


18 


103 


39 


3h 


19U 



Table 2 shows that the great majority of disagreanents have a difference of 1 in weight. Of the 
56 disagreements only U had a difference of more than 1. The most serious disagreement was the case 
where MEDICO gave a weight of 3 to a linked term and the manual evaluation recorded for it a weight of 
0. The term in question was erroneous because an incorrect link was involved. Therapy was linked with 
phenobarbital whereas the article was concerned with the treatment of phenobarbital poisoning. 

The total proportion of agreements between the two methods was 0.71 (138/19U). A 95 % confidence 
interval for the true proportion of agreements is from 0.65 to 0.77. Ninety-eight percent of the weights 
assigned by the two methods were found to be either in agreement or to differ by a weight of 1. 

A moderate increase in agreement was observed when the classifications having weight 3 by either 
or both methods were considered. The proportion of agreanent in that case was 0.78 (28/36) yielding a 
confidence interval of 0.6U to 0.92. 
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Links Between Drug Terms and Modifiers 

In the evaluation of the linking procedure again the MEDICO output was compared with manual 
results. The purpose of the test was to (l) determine the proportion of relevant links, (2) determine 
whether writing style has an effect on the proportion of relevant links, and (3) consider criteria other 
than co-occurrence in a sentence in defining a link. Table 3 and h summarize the results from the 
linking evaluation. 

The MEDICO procedure recorded a total of 285 links of which 63 were judged irrelevant. The 
average number of wards between the terms which were linked was 3.71 words while the average link 
distance for the irrelevant links was 7.08 words. This difference in linear distance suggested that 
perhaps the criterion of co-occurrence within a sentence should be revised. For example, suppose we 
consider only those links whose distances are less than the grand average 3.71 plus 2 standard devia- 
tions. This approach would be valid if (l) the variance of the link distances for each article appear 
homogeneous and (2) the average of the link distances for each article are homogeneous. Bartlett*s test 
for homogeneity of variance on the link distances gave significant results for both relevant and 
irrelevant links. This result was not too surprising since we would expect larger variances to be 
associated with larger average link distances. (As a matter of fact, we expect the variances to be 
proportional to the average link distances.) If we consider the log of the link distance rather than 
the link distance itself, the non-homogeneity of variance is removed. 

An Analysis of Variance of the log of the distances was then performed which considered the 
following factors: link types (relevant and irrelevant), authors, and the author by link type inter- 

action. The results revealed a significant author by link type interaction. We thus conclude that it 
is not feasible to consider a fixed length in order to separate relevant and irrelevant links. The 

magnitude of the difference between average lengths of relevant and irrelevant links is dependent on 

authors (writing style). 

Summary 

Evaluation of the effectiveness of the methods used for the automatic assignment of weights and 
links showed some interesting results. 

A comparison of the weights assigned to terms using the MEDICO and manual procedures gave the 
same value for 71$ of the terms generated by either procedure. A moderate increase in agreement (78$) 
was observed when only terms having a weight of 3 by at least one of the methods were considered. 

Ninety-eight percent of the weights assigned by the two methods were found to be either in agreement 

or to differ by a weight of 1. These findings seem to indicate that the scale of the method of weighting 
should be revised, allowing perhaps only two weights in the system instead of three. Future research 
would have to examine the validity of this assumption. 
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Table 3: Summary of Link Data 



1 



i 



i 

\ 



Article 


# of 
Links 




Relevant Links 






Irrelevant Links 




Average 


Variance 


Average 

Logs 


Variance 

Logs 


Average 


Variance 


Average 

Logs 


Variance 

Logs 


1 


19 


U.83 


UU.17 


.Uo5 


.261 


3.77 


11.03 


.U67 


.08U 


2 


1U 


U.oo 


10.67 


.5iU 


.075 


5*86 


29. U8 


.5Uo 


.275 


3 


57 


3.98 


16.98 


.U22 


.1U7 


9.U2 


28. U5 


.913 


.058 


h 


10 


3.70 


3.3U 


.5io 


.06U 


- 


- 


- 


- 


5 


13 


U.75 


17.11 


.529 


.lU2 


12.00 


- 




“ 


6 


6 


3.00 


8.U0 


.317 


.158 


- 


- 


- 


- 


7 


11 


3.00 


1.71 


.UU9 


.025 


13.67 


69.33 


1.083 


.068 


8 


27 


U.92 


25.91 


.5U5 


.liU 


5.50 


12.50 


.690 


.091 


9 


25 


3.88 


16.20 


.U31 


.126 


5.00 


- 




- 


10 


5 


5.67 


5.33 


.722 


.oU5 


6.00 


32.00 


.651 


.2 hh 


11 


19 


5.50 


21.56 


.598 


.129 


25.00 


- 


- 


- 


12 


39 


2.50 


28.58 


.116 


.125 


10.12 


55.8U 


.92U 


.071 


13 


29 


2.67 


3.88 


.298 


.120 


U.55 


17.07 


.501 


•150 


1U 


10 


2.62 


1.12 


.395 


.021 


3.00 


0.00 


0.00 


- 


15 


6 


2.00 


6.00 


.1 la 


.119 


- 


— 


— 


— 




KBaa^ttllllBfBisaiiHaiBi 












12 




\ 



; * 



Table U: Summary of Link Data 



Article 


# of 
Links 




Relevant Links 




Irrelevant Links 


Number of 
Links 


Average number 
of words 
to 2nd term 


Variance 
of link 
distances 


Number of 
Links 


Average 
of link 
distances 


Variance 
of link 
distances 


1 


19 


6 


U .83 


liU .17 


13 


3.77 


11.03 


2 


1 U 


7 


U.oo 


10.67 


7 


5.86 


29 . U 8 


3- 


57 


U 5 


3.98 


16.98 


12 


9. U 2 


28 . U 5 


h 


10 


10 


3.70 


3 . 3 k 


0 


0 


- 


5 


13 


12 


U .75 


17.11 


1 


12.00 


mm 


6 


6 


6 


3.00 


8. U 0 


0 


- 


- 


7 


11 


8 


3.00 


1.71 


3 


13.67 


69.33 


8 


27 


25 


U .92 


25.91 


2 


5.50 


12.50 


9 


25 


2 U 


3.88 


16.20 


1 


5.00 


- 


10 


5 


3 


5.67 


5.33 


2 


6.00 


32.00 


11 


19 


18 


5.50 


21.56 


1 


25.00 


- 


12 


3 U 


26 


2.50 


28.58 


8 


10.12 


55.8 U 


13 


29 


18 


2.67 


3.88 


11 


U .55 


17.07 


1 U 


10 


8 


2.62 


1.12 


2 


3.00 


0.00 


15 


6 


6 


2.00 


6.00 


0 


- 


- 


Totals 


285 


222 


3.71 




63 


7.08 
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Seventy-two percent of the links generated by a full text scan of the articles by the MEDICO pro- 
cedure were relevant. While writing style does not appear to have an effect on the proportion of agree- 
ments on weights for the two methods the percentage of relevant links observed was found to be dependent 
on the author's writing style. The proportion of relevant links decreased as the average length of 
the sentences increased. This seems to suggest that it may be desirable to change the definition of a 
link from co-occurrence within a sentence to co-occurrence within two punctuation marks. A preliminary 
check of the l£ articles studied showed that the number of relevant links would increase to 8h% as a 
result of such a re-definition. Further research is needed to study this assumption in detail. 
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IV. COMPARISON OF OUTPUT FROM FULL TEXT WITH OUTPUT GENERATED FROM 

ABSTRACTS OR SUMMARIES 



Introduction 

Evaluation also included a comparison between the output generated fran full text with output 
from abstracts or summaries of the same articles. 

This type of comparison is important because there is good reason to believe that the difference 

in cost between the two methods is considerable. Data relating to the relative effectiveness of the two 

methods should give some indication of the degree of improvement that can be expected for the additional 
expense involved in full text processing. 

The purpose of this investigation was to evaluate the following questions: 

(1) Does an abstract provide a better index than a summary paragraph? 

(2) Do the terms which have a weight of 3 in the full text index appear more frequently in the 

reduced text irelex than terms which have a weight of 2 or a weight of 1? 

(3) Can we consider the link distance or some function of the average link distance in order to 
segregate relevant and irrelevant links? 

Weights 

The average number of words in the reduced text was 127. This relatively small size makes it 
impossible to rank the importance of terms indexed by assigning weights. We must assume that any term 
mentioned in the reduced text is important. Under an ideal situation we would expect only terms having 
weight 3 in the full text index to appear in the reduced text index. The more realistic case, however, 
is to expect terms having weight 3 in the full text to have a greater frequency of appearance in the 
reduced index than weight 2 terms which should be more frequent than weight 1 terms. Table 5 gives the 
number of terms with their previously assigned weights and indicates whether they were included or 
omitted in the indexing of the reduced text. 

To test the hypothesis that an abstract or summary paragraph provides the same amount of informa 
tion, we considered the frequency of terms indexed and not indexed for the two forms of reduced text 

g 

with the three weights considered separately. For the weight of 3 terms, the observed X value was 
0.122j weight 2 terms had an observed X a of 0.96 while the weight 1 terms gave a value of 0.09ir« The 
three X s values are not significant at any reasonable level, therefore we accept,. the hypothesis that the 
two forms give the same amount of information. 

We now combine the information from the two forms of reduced text to test the hypothesis that 
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Table S: 


Number of 


Terms in Full 


Text 












Indexed 






Not indexed 




Form of 




Weight 


We ight 


Weight 


Weight 


Weight 


Weight 


Reduced Text 


Article 


3 


2 


1 


3 


2 


1 


Abstract 


k 


2 


0 


0 


0 


1 


h 


Abstract 


S 


1 


1 


0 


l 


h 


1 


Abstract 


7 


1 


0 


1 


0 


1 


1 


Abstract 


8 


k 


2 


0 


0 


1 


9 


Abstract 


10 


0 


0 


0 


0 


1 


S 


Abstract 


11 


S 


10 


3 


1 


2 


ll 


Abstract 


12 


2 


0 


0 


0 


1 


2 


Abstract 


13 


2 


2 


0 


0 


1 


8 


Abstract 


lit 


1 


0 


1 


0 


1 


h 


Summary 

Paragraph 


2 


3 


0 


0 


1 


0 


2 


Summary 

Paragraph 


3 


u 


2 


2 


0 


h 


26 


Summary 

Paragraph 


6 


2 


1 


0 


0 


7 


0 


Summary 


9 


2 


2 


2 


1 


0 


5 


Paragraph 

Summary 

Paragraph 


y 

IS 


0 


2 


1 


0 


1 


3 


Summary 

Paragraph 


i 


1 


0 


1 


1 


1 


5 


Abstract 




18 


is 


5 


2 


13 


Si 


Summary 

Paragraph 




12 


7 


6 


3 


13 


hi 


Total 




30 


22 


11 


5 


26 


92 
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the frequency of teims indexed using a reduced text is independent of the assigned weights from a full 
text analysis* The observed value is 69.8U which is significant at the 0*01 level* We thus conclude 
that the probability of a tern being indexed in a reduced text is dependent on the previously assigned 
weight using the full text analysis. Tenns with high weights have a greater probability of being indexed 
than those with low weights. 

Now we consider only terns generated from reduced text. Of the total of 63 terms assigned, 30 
had a weight of 3, 22 a weight of 2, and 11 a weight of 1 in the full text analysis. A X a test to test 
the hypothesis that each weight has the same expected frequency (N/3) in the reduced index gave a value 
of 8,67/. The critical value for x 8 at a level of 0.02 is 7.82. We thus conclude that the expected fre- 
quency is greater for terms which were assigned higher weights on the basis of full text scanning* 

All calculations for the above statistical tests are listed in the appendix. 

Links Between Drug Terms and Modifiers 

The statistical tests relating to the links which were generated from reduced text were designed 
to answer the question vdiether the distance between links or some function of the average distance be- 
tween links can be considered in order to segregate relevant and irrelevant links. 

It was found that the average of the relevant link distances was 3.U vdiile the average irrelevant 
link distance was 8.9 words. Table 6 shows that U of the irrelevant link distances were quite large when 

Table 6: Summary of the Link Data 



Article 


Number of 
Links 


Relevant 

Number of 
Links 


Links 

Length of 
Links 


Irrelevant 

Number of 
Links 


Links 

Length of 
Links 


1 


1 


1 


S 


0 


- 


2 


2 


1 


2 


1 


1 


3 


U 


2 


U,1 


2 


11,18 


h 


1 


1 


s 


0 


- 


5 


1 


1 


8 


0 


- 


6 


1 


1 


1 


0 


- 


7 


1 


1 


2 


0 


- 


8 


3 


3 




0 


- 


9 


3 


2 


s,i 


1 




10 


0 


0 


- 


0 


- 


11 


3 


3 


7,2,S 


0 


- 


12 


1 


1 


1 


0 


- 


13 


h 


2 


u,i 


2 


11, Ik 


lU 


1 


0 


- 


1 


2 


IS 


1 


1 


1 


0 


- 


Totals 


27 


20 


68 


7 


62 
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compared to the lengths of the relevant links (11, 18, 11, lU). This would indicate that a significant 
reduction in the frequency of irrelevant links might occur by defining a link as the co-occurrence within 
a predetermined distance. For example, suppose we consider only links of 10 words or less in distance. 
This criterion would yield 23 links of which 20 are relevant. The upper limit of 10 was obtained by 
considering the average of tte relevant link distances (3.U) plus 3 standard deviations of the relevant 
link distances (2.16). 

It should be pointed out that this observation about link distance is based on a small sample 
size (27). Previous data from the full text analysis indicate that the average of the relevant link 
distances is dependent on the author's writing style. However, it might happen that all authors write 
in a more concise form in a summary paragraph or an abstract. Future investigations with larger sample 
sizes should shed more light on this observation. 

Summary 

Since no significant difference was found in the two forms of reduced text, abstracts and 
summaries, they were considered together in the evaluation. 

A comparison of the index terms generated from full text with those which were generated from 
reduced text showed that the proportion of terms indexed from reduced text is greater for those terms 
which had high weights in the full text analysis. Eighty-six percent of terms having a weight of 3> 
h6% of the terms having a weight of 2, and 11% of the terms having a weight of 1 in the full text 
analysis were also generated from reduced text. 
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I. Weights 

A. y® test for independence of proportion of agreement on author 



Article 



Agreement 



Disagreement 





Observed 


Theoretical 


Observed 


Theoretical 


1 


8 


6.U0 


1 


2.60 


2 


3 


U.27 


3 


1.73 


3 


28 


29.15 


13 


H.85 


U 


5 


U.98 


2 


2.02 


5 


12 


9.2U 


1 


3.76 


6 


7 


7.82 


U 


3.18 


7 


3 


2.8U 


1 


1.16 


8 


lU 


12.09 


3 


U.91 


9 


ll 


9.95 


3 


U.05 


•10 


U 


U.27 


2 


1*73 


11 


22 


22.75 


10 


9.25 


12 


3 


U.27 


3 


1.73 


13 


7 


9.95 


7 


U.05 


lU 


5 


U.98 


2 


2.02 


15 


6 


U.98 


1 


2.02 


Totals 


138 


138 


56 


56 




15 2 , 


.3 








>•- I IfSu^u 

1=1 j=l lj 


* } =12.66 







X® (df=l4) = 21.06 
as=0.10 



Conclusion: 



Accept hypothesis of independence since 



a 



X < x ® 

<*=.10 
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B. 95 % confidence interval for proportion of agreements {all weights) 



9 - 138 A94 = .71 

V = •« 
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.71 - 1.96(.032) s p £ .71 + 1.96(.032) 

» 

.65 sps ,77 
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C. 95 % confidence interval for proportion of agreements having weight 3 by at least one method 



t = 28 /36 = .78 



« - 069 



= 7 ' 



36 



.78 - 1.96(.069) s: p £ .78 + .14 



.64 s£ p £ ,92 
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II . Links 



A. Testing for Homogeneity of Variance 
1. Original Data 



Variance of Link Distances 



Article 


Relevant Links 


Irrelevant Links 


1 


Ul .17 


11.03 


2 


10.67 


29. U 8 


3 


16.98 


28 . U 5 


k 


3.3 U 




5 


17.11 


... 


6 


8. U 0 


— 


7 


1.71 


69.33 


8 


25.91 


12.50 


9 


16.20 




10 


5.33 


32.00 


11 


21.56 




12 


28.58 


55.8 U 


13 


3.88 


17.07 


1 U 


1.12 


0.00 


15 


6.00 





Bartlett's statistic: B = ^ £ £(n^ _ l)in s 3 — E(n^ - l)la s 3 j- 

where 

° = 1+ 3(k-l) [ E 1 “ £(n*- l) ] 

B = 102.8 

Conclusion: 

Reject hypothesis of homogeneity of variance since 



B > x 3 (df=23) = 52.6 

a =.001 



mmmsm 






mmmm 



2. Transformed Data (Log of the link distance) 



Variance of Link Distances 



Article Relevant Links Irrelevant Links 



1 


.2613 


.U673 


2 


.0752 


1.2356 


3 


.1U67 


.6607 


h 


.06U2 


— 


5 


.1U21 


— 


6 


.1582 




7 


.0253 


1.1659 


8 


.1137 


.5U56 


9 


.1261 


— 


10 


.oU5i 


1.3765 


11 


.1293 


— 


12 


.1219 


1.0357 


13 


.1203 


.7222 


lit 


.0211 


.0000 


15 


.1190 


— - 



Bartlett's statistic: 



B = 25.9 



Conclusion: 



Accept hypothesis of homogeneity of variance since 



B < x 3 - 34.38 

ot=0. 10 



3. Analysis of variance of log of link distances 



Source 


D.f. 


S.S. 


M.S. 


F 


Interaction of articles and link types 


11 


.3238 


.29UU 


2 .U2 


258 


.3lUl 


.1218 





Conclusion: 

Reject hypothesis of no interaction since 

P > P #99 (11,258) = 2.3 

and conclude that average link distance is dependent on article selected. 
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j 2. Statistical Tests for Reduced Text 
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I. Tests the hypothesis that MEDICO index is independent of the form of the reduced text. 
A. Weight three terns 





Indexed 


Not Indexed 




Abstract 


18 


2 


20 


Summary 


12 


3 


IS 


To tals 


30 


S 


3S 



- > { 'V 



PP 



n n 1 
is si 



a 




11 



n )(n + n )(n + n )(n + n ) = 0.122 

Sl IS SS 11 13 31 33 



X s (df=l) = 3.841 
a=.05 



! B. Weight two terms 

i 

I 

! 

Abstract 

Summary 

Totals 

X 8 = 0.96 



Indexed Not Indexed 
IS 13 

7 13 

22 26 



28 

20 



U8 



t 



C. Weight one terms 



Abstract 

Summary 






Indexed 


Not Indexed 




S 


si 


S6 


6 


ia 


h7 



Totals 11 92 103 

X 8 = 0.094 

Conclusion: Accept hypothesis that frequency of indexing is independent of form of reduced text 

since the three observed values are all less than y S critical value of 3»81fL 

(df = .OS). 
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II. Testing the hypothesis that indexing is independent of previously assigned weight from full text 
analysis. 



31 



Indexed Not Indexed 





Observed 


Expected 


Observed 


Expected 


Weight 3 


30 


11.8^ 




23.15 


Weight 2 


22 


16.26 


26 


31.7U 


Weight 1 


11 


3U.89 


92 


68.11 


Totals 


63 


63 


123 


123 



r s = T Y )■«•» 

i=l j-l ' B ij 

x* (df=2) = 10.597 
a=,005 

Conclusion: Reject hypothesis that indexing in reduced text is independent of previously 

assigned weight using full text 



III. Testing the hypothesis that the proportion of indexed terns of reduced text is the same for all 



weights* 



Observed Expected 

Weight 3 30 21 

Weight 2 22 21 

Weight 1 11 21 

Totals 63 63 

x 8 = H (o i -V/.j-a.CT 

i=l i_ 



x 8 (df=2) = 7.82 x 8 (df=l) = 9.21 
a=0.02 a=0.01 

Conclusion: Reject hypothesis that proportion of indexed terms is the same for all weights 

(level of significance = 0.02). 



IV. Links 

Average of relevant links = 68/20 = 3.1*0 words 
Average of irrelevant links = 62/7 = 8.86 words 

/ 27 , -X s 

Standard deviation of relevant links = 8 R = ' S '*1 ~ *7 = 2,16 



Upper limit for links - 3.U0 + 3(2.16) = 9»9 words 
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3. Terms for Each Article with Their Respective Weights 



3U 

Article 1 



Terms 


MEDICO 


Manual 


Diphenylhydantoin 


2 


2 


Barbiturates 


3 


3 


Amobarbital 


1 


1 


£-ethyl-£-phenylbarbituric acid 


1 


1 


D iphenylhyda nto in/The rapy 


1 


1 


Ba rb i tura t e/Ef f e c t 


1 


1 


/Activity 


1 


1 


/Therapy 


3 


0 


/Dosage 


1 


1 


Article 2 


Terms 


MEDICO 


Manual 


Barbiturates 


3 


3 


5 > - e thyl-5 - phe nylba rb i t ur i c acid 


3 


3 


Phenobarb ital/Therapy 


3 


0 


/Dosage 


2 


3 


Barbiturates/Administration 


1 


1 


/Therapy 


1 


0 


Article 3 


Terms 


MEDICO 


Manual 


Anticonvulsants 


3 


3 


Barbiturates 


3 


3 


5-ethyl-5-phenylbarbituric acid 


2 


2 


Mephobarbital 


1 


1 


Primidone 


2 


2 


Hydantoins 


1 


1 


D iphenylhyda nto in 


3 


3 


Triinetha di o ne 


2 


3 


Phensuximide 


1 


1 


Celontin 


1 


1 


Ethosuximide 


1 


1 


Phenacemide 


1 


1 


Mephenytoin 


1 


1 


Anticonvulsants/Epilepsy 


1 


1 


/Activity 


3 


3 


/Effect 


1 


0 


/Properties 


1 


1 


/Therapy 


1 


1 


Barbiturates/Epilepsy 


1 


1 


/Activity 


2 


1 


/Effect 


1 


1 


Hydantoins/Epilepsy 


1 


1 


De phenylhydan to in/ Ac t i v ity 


2 


2 


/Therapy 


1 


1 


/Effect 


1 


1 


/Epilepsy 


1 


1 


Trimethadione/Administration 


1 


0 


/Activity 


2 


1 


/Dosage 


1 


0 


Pr imidone/ Epilepsy 


1 


1 


/Therapy 


1 


1 


Phenobarbital/Activity 


1 


0 


/Epilepsy 


1 


1 


/Dosage 


1 


1 


Me phoba rb ita 1/Therapy 


1 


1 


Metharbital 


0 


1 


Trimethadione/Effect 


0 


1 
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Article 3 (continued) 



Term 


MEDICO 


Manual 


Phen suximide/Therapy 


0 


1 


Trimethadione/Therapy 


0 

A 


X 


Primidone/Activity 


0 

A 


1 


Anticonvulsants/Adverse reactions 


0 


X 


Article U 






Term 


MEDICO 


Manual 


5-ethyl-5 phenylbarbituric acid 


2 


2 


Anticonvulsants 


1 


X 

A 


Diphenylhyda n to in/A dmin is t ra t ion 


2 

A 


3 


/Effect 


1 


X 

A 


/Dosage 


1 

-1 


2 


Anticonvulsants/Administration 


1 


X 

o 


Diphenylhydantoin 


3 


3 


Article 5 






Term 


MEDICO 


Manual 


Amobarbital 


2 


2 


5 -ethyl-5 phenylbarbituric acid 


3 

A 


3 

o 


Ant iconvulsants 


2 


2 

A 


D ip he nylhyda ntoin 


3 

-i 


3 


Amytal/Therapy 


1 


X 


Amoba rbital/The rapy 


1 


1 

“1 


Phenobarbital/Administration 


1 


1 


/Effect 


1 


1 


/Therapy 


2 


1 


Anticonvulsants/Epilepsy 


1 


1 

A 


/Therapy 


1 


1 

A 


Diphe nylhyda nto in/Do sa ge 


2 


2 

A 


Barb itura te s/ Act ivi ty 


1 


1 


Article 6 






Term 


MEDICO 


Manual 


5-ethyl -5 -phenylbarbituric acid 


2 

A 


2 

o 


Diphenylhydantoin sodium 


2 

o 


2 

2 

A 


Anticonvulsants 


2 


Barbiturates 


2 


2 

A 


Diphenylhydantoin 


2 


3 

A 


Dilantin sodium/Therapy 


2 


2 

A 


Anticonvulsants/Epilepsy 


2 


2 

A 


Barbiturates/Epilepsy 


2 


2 


Dilantin/Effect 


2 


0 


/The rapy 


2 


3 


Dilantin/ Adverse reactions 


0 


i 


Article 7 






Term 


MEDICO 


Manual 


Antispasmodic 


3 


3 


/Effect 


2 


2 


/Adminis t rat io n 


1 


1 


/Activity 


1 


0 



0 
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Article 8 



t 




Term 

Anticonvulsants 

£-ethyl-£ phenylbarbituric acid 

Dimethadione 

Diphenylhydanto in 

Trine thadione 

Anticonvulsants/Effect 

/Activity 

Phenoba rbitone/Ef f ec t 
/Therapy 
/Administration 
/Activity 

Diphenylhydanto in/Ac tivity 
/Effect 

Dinethadione/Activity 
Trine thadione /The rapy 
D ine thad ione /The ra py 
Anticonvulsants/Dosage 






Article 9 



Term 

Diphenylhydanto in sodium 

Anticonvulsants 

Carbamazepine 

Diphenylhydantoin sodium/Effect 

/Therapy 

/Administration 

/Properties 

/Activity 

Anticonvulsants/Effect 

/Properties 

Contamazepine/Therapy 

/Effect 

Dilatin 

Hydantoins 



Article 10 

Term 

Barbiturates 

Antispasmodic 

Barbiturates/Therapy 

/Activity 

/Effect 

/Dosage 



Article 11 

I 

j Term 

Anticonvulsants 

; 5>-ethyl-5>-phenylbarbituric acid 

| ^ -methyl -5 phenylbarbituric acid 

Primidone 

t Diphenylhydantoin sodium 

Diphenylhydantoin 
i Mephenytoin 

Trine thad ione 

Ethosuximide 

Phensuximide 






MEDICO 

3 

3 

3 

3 

1 

1 

1 

2 

1 

1 

1 

1 

2 

1 

1 

0 

0 



MEDICO 

3 

2 

3 

3 

2 

1 

1 

1 

1 

1 

1 

1 

0 

0 



MEDICO 

2 

1 

1 

1 

1 

1 



MEDICO 

3 

3 

1 

3 

2 

3 

2 

3 

1 

1 



Manual 

3 

3 

3 

3 

1 

2 

1 

2 

1 

1 

1 

1 

2 

1 

1 

1 

1 



Manual 

3 

2 

3 

3 

2 

1 

1 

1 

1 

1 

0 

1 

1 

1 



Manual 

2 

1 

0 

1 

1 

0 



Manual 

3 

3 

2 

3 

3 

3 

2 

3 

2 

2 
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Article 11 (continued) 

Term 

Celontin 

N-benzyl-Beta-chloropropanamide 
Tetrahyd ro-2-p-sulfamoyl -phenyl-1, 2-thiazi 
(2-phenylbutyryl) urea 
Phenacemide 
Carbamazepine 
Anticonvulsants/Therapy 
/Dosage 
/Effect 
/Properties 

Phenylmethylbarbituric acid/Dosage 
Barbiturates/Dosage 
Phenoba rbito ne/Dosage 
/Effect 

Primidone/Eff e c t 
/Dosage 
Phenyto in/Dosa ge 
/Therapy 
Trox idone/Ef feet 
Be c lam ide/Ef feet 
Priminal 
Hydantal 



Article 12 

Tern 

Anticonvulsants 

/Activity 

/Effect 

/Administration 

/Therapy 

/Dosage 



Article 13 

Tern 

Trimethadione 

£-ethyl-£ phenylbarbituric acid 
Anticonvulsants/Properties 
/Activity 
/Effect 
/Epilepsy 

Trimethadione/Adminis tra tion 
/Dosage 
/Activity 
Phenoba rbital/Activity 
Ant iconvulsa nt s 
Diphenylhydanto in 

" /Activity 

Trime t hadione/Ef feet 



Article lit 

Tern 

Trimethadione 

/Administration 

/Effect 

/Activity 



MEDICO Manual 

1 2 

2 2 

1,1-dioxide 1 2 

2 2 

1 1 

1 2 

1 1 

1 1 

2 2 

1 1 

1 1 

2 2 

2 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

0 1 

0 1 



MEDICO Manual 

3 3 

3 3 

2 0 

1 1 

1 0 

0 1 



MEDICO Manual 

3 3 

1 1 

1 1 

2 2 

2 1 

1 0 

2 1 

1 1 

1 1 

1 0 

3 3 

0 1 

0 1 

0 1 



MEDICO Manual 

3 3 

1 1 

1 0 

1 0 
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Article lU (continued) 
Tem 

T rime thad ione /Dos a ge 

/Epilepsy 

/Therapy 

Article 15 



Tem 

Mephobarbital 

Diphenylhydantoin 

Anticonvulsants 

5 -ethyl-5 phenylbarbituric acid 
Anticonvulsants/Therapy 
Phenobarbital/Therapy 
Mebroin 



i 



l 

v, 

\ 



MEDICO Manual 



2 

1 

1 



2 

1 

1 



MEDICO Manual 



1 

2 

2 

1 

2 

1 

0 



1 

2 

2 

1 

2 

1 

1 
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1;. Output From Full Text 



1 

1 






i. 

jr 

! 

j 

| 



j 

y 
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BERNSTEIN ZL 

TREATMENT OF BARBITURATE COMA. 

NEW YORK J MEC 66t 2290-4, 1 SEP 66 

NO. OF WORDS * 2428 

57410 (2) DIPHENYLHYDANTOIN, 5 , 5-CI PHENYL-2, 4-IMI DAZOLI DI NEDIONE , 
HYDANTOINS 

(3) BARBITURATES 

57432 (II AMOBARBITAL, 5-ETHYL-5-IS0AMYLBARBITURIC ACID, BARBITURATES 
50066 (1) 5-E.THYL-5-PHENYLBARB ITURIC ACID, PHENCBARBITAL, BARBITURATES 



DIPHENYLHYDANTOIN/ THERAPY (1) 

BARBITURATES/ EFFECT (1), ACTIVITY (1), THERAPY (3), DOSAGE Cl) 



0 F 



E N D 



ARTICLE 
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NEALON TF JR, SUGERMAN H f SHEA VI 

AN EXTRACORPOREAL DEVICE TO TREAT BARBITURATE POISONING. USE OF 
ANION- EXCHANGE RESINS IN DOGS. 

JAMA 197t 158— 160t 11 JUL 66 

NO. OF WORDS = 1639 
(3) BARBITURATES 

50066 (3) 5-ETHYL-* 5-PHENYLBARE ITURI C AC ID» PHENCBARBITALt BARBITURATES 



PHENOBARBITAL/ THERAPY (3)# DCSAGE (21 
BARBITURATES/ ADMINISTRATION (l)t THERAPY (1) 



END 



OF ARTICLE 



h2 

LIPP JA 

EPILEPSY. II. BASIC NEUROPHYSIOLOGICAL ASPECTS OF ANTICONVULSANT 
DRUGS. 

APPL THER 8t 437-41, PAY 66 

NO. OF WOROS = 3001 
(3) ANTICONVULSANTS 

(3) BARBITURATES 

50066 (2) 5-ETHYL-5— PHENYLBARE ITURIC ACID* PHENOBARBITALt BARBITURATES 

115388 (1) MEPHOBARBITALt 5-ETHYL-1-METHYL-5-PHENYLBARBITURIC ACICt 
BARBITURATES 

125337 (2) PRIMIDONE * 5-PHENYL-5-ETHYLHEXAHYDR0PYRIMICINE-4, 6-DIONE, 
BARBITURATES 

(1) HYDANTOINS 

57410 (3) DIPHENYLHYDANTOIN, 5,5-CIPHENYL-2,4-lPI0AZ0LlDlNEDl0NE, 
HYDANTOINS 

127480 (2) TrIMETHADIONE* 3,5,5-TRIPETHYL-2,4-OXAZOLlClNEDlONE, 

OXAZOL IDI NEDIONES 

86340 (1) PHENSUXIMIDEt N-METFYL-2-PHENYLSUCCINIMIDE, SUCCINIMIDES 

77418 (1) CELGNTINt N,2-DIMETFYL-2-PHENYLSUCC INIMIDE, SUCCINIMIDESt 
METHSUXIMIDE 

77678 (1) ETHOSUXIMIDEt 2-ETHYL, 2-METHYLSUCCI NIMI OE, SUCCINIMIDES 
63989 (15 PHENACEMIDE, PHENYL ACETYLUREA 

50124 (1) MEPHENYTOINt 5— ETHYL-3— METHYL— 5-PHENYLH YD ANTO IN, HYDANTOINS 



ANTICONVULSANTS/ EPILEPSY (1), ACTIVITY (3)t EFFECT (1), PROPERTIES (1) 
THERAPY (1) 

BARBITURATES/ EPILEPSY (1), ACTIVITY (2)t EFFECT (1) 

HYDANTOINS/ EPILEPSY (1) 

DIPHENYLHYDANTOIN/ ACTIVITY (2), THERAPY (1), EFFECT (l) f EPILEPSY fl) 
TRIMETHADIONE/ ADMINISTRATION (1), ACTIVITY (2), DOSAGE (1) 

PRIMIDONE/ EPILEPSY (1), THERAPY (1) 

PHENOBARBITAL/ ACTIVITY ID, EPREPSY (1), DOSAGE (1) 

MEPHOBARBITAL/ THERAPY (1) 



0 F 



END 



ARTICLE 
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^3 



KLEIN JP 

DIPHENYLHYDANTOIN INTOXICATION ASSOCIATED WITH HYPERGLYCEMIA. 

J PEDIAT 69,463-5, SEP 66 

NO. OF WORDS = 1219 

57410 (3) DIPHENYLHYDANTOIN , S,5-CIPHENYL-2,4-IMIDAZ0LIDINEDI0NE, 
HYDANTOINS 

50066 (2) 5— ETHYL-5-PHENYLBARE ITURIC ACID, PHENCBARBITAL, BARBITURATES 
(1) ANTICONVULSANTS 



DIPHENYLHYDANTOIN/ ADMINISTRATION (2), EFFECT (1), DOSAGE (1) 
ANTICONVULSANTS/ ADMINISTRATION 11) 



END OF ARTICLE 
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BUCHANAN OS 

AN APPROACH TO MANAGEMENT OF STATUS EPILEPTICUS. 

SOUTHWEST MEO 47*187-9* JUL 66 

NO. OF WORDS * 1760 
(2) BARBITURATES 

57432 (2) AMOBARBITAL* 5-ETHYL-5-ISGAMYLBARBITURIC ACID* BARBITURATES* 
AMYTAL 

50066 ( 3) 5-ETHYL-5— PHENYLBARE ITURI C ACID* PHENCBARBI TAL* BARBITURATES 
(2) ANTICONVULSANTS 

57410 (3) DIPHENYLHYDANTOIN* 5*5-CIPHENYL-2*4-IMIDAZOLIOINEDIONE* 
HYDANTOINS 



AMYTAL/ THERAPY (11 
AMOBARBITAL/ THERAPY (1) 

PHENOBARBITAL/ ADMINISTRATION (11* EFFECT (II* THERAPY (21 
ANTICONVULSANTS/ EPILEPSY (1)* THERAPY (l) 
DIPHENYLHYDANTOIN/ DOSAGE (2) 

BARBITURATES/ ACTIVITY (1) 



END OF ARTICLE 



FIG. 1 
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b$ 



ARMBRECHT ECt STEERE DW . . _ 

A CASE REPORT OF EVALUATICN AND MANAGEMENT OF HYPERPLASTIC GINGIVA IN 

EPILEPTICS CAUSED BY SODIUM DILANTIN 
W VIRGINIA DENT J 40,43-4, JUl 66 

NO. OF WORDS = 906 

50066 (2) 5— ETHYL— 5— PHENYLJBARE ITURI C 

630933 (2) DIPHENYLHYDANTOIN SODIUM, 

HYDANTOINSt DILANTIN SODIUM 

(2) ANTICONVULSANTS 

(2) BARBITURATES 

57410 (2) DIPHENYLHYDANTOIN, 5,5-DI PHENYL-2, 4-IMIOAZOLIDINEDIONE, 
HYDANTOINS, DILANTIN 



THERAPY. 

ACID, PHENOBARBITAL, BARBITURATES 
SODIUM 5,5-DIPHENYL HYDANTOINATE , 



DILANTIN SODIUM/ THERAPY (2) 
ANTICONVULSANTS/ EPILEPSY (2) 
BARBITURATES/ EPILEPSY (2) 
DILANTIN/ EFFECT C2), THERAPY (21 



END OF ARTICLE 



46 



DOUGLAS A, SIMPSON D» MERCHANT S 

THE EFFECT OF ANTISPASMODIC DRUGS ON THE ENDOMURAL BRONCHIAL (OR 
SQUEEZE) PRESSURES IN BRONCHITIS AND ASTHMA. 

AMER REV RESP DIS 93t703-15t MAY 66 

NO. OF WORDS = 4425 
(3) ANTISPASMODIC 



ANTISPASMODIC/ EFFECT <2)t ADMINISTRATION (l)t ACTIVITY (1) 



END OF 



ARTICLE 















h7 



GILBERT JC, ORTIZ WR, MILLICHAP JG 

THE EFFECTS OF ANTICONVULSANT DRUGS ON THE PERMEABILITY OF BRAIN 
CELLS TO D-XYLOSE. 

J NEUROCHEM 13,247-55, APR 66 



NO. OF WORDS = 3338 
(3) ANTICONVULSANTS 

50066 (3) 5— ETHYL-5-PHENYLBARE ITURI C ACID, PHENOBARBITAL, BARBITURATES 

695534 (3) DIMETHADIONE * 5 , 5-C IMETH YLOX AZOLI D I NE-2 ,4-CION E , 

OXAZOL IDINEDIONES 

57410 (3) DIPHENYLHYDANTOIN, 5 , 5-CI PHENI YL-2 ,4-1 MI DAZOLI DI NEDI ONE , 
HYDANTOINS 

127480 (1) TRIMETHADIONE, 3,5 ,5-TRI METHYL-2, 4-0XAZ0LIDINEDI0NE, 

OXAZOL IDINEDIONES 



ANTICONVULSANTS/ EFFECT (1), ACTIVITY (1) 

PHENOBARBITONE/ EFFECT (2), THERAPY (1), ADMINISTRATION (1), 
ACTIVITY (1) 

DIPHENYLHYDANTOIN/ ACTIVITY ( 1 ) » EFFECT (2) 

DIMETHADIONE/ ACTIVITY (1) 

TRIMETHADIONE/ THERAPY (1) 



END OF ARTICLE 
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U8 

CHINITZ a, seelinger df, greenhouse ah 
ANTICONVULSANT THERAPY IN TRIGEMINAL NEURALGIA. 
AMER J MED SCI 252,62-7, JUL 66 

NO. OF WORDS = 2427 

630933 (3) DI PHENYL HYDANTG IN SODIUM, SODIUM 5,5 
HYDANTOI NS 

(2) ANTICONVULSANTS 

298464 13) CARBAMAZEP INE , TEGRETOL 



DIPHENYLHYDANTOIN SODIUM/ EFFECT (3), THERAPY C 
PROPERTIES (1), ACTIVITY (I) 

ANTICONVULSANTS/ EFFECT (1), PROPERTIES (1) 
CARBAMAZEPINE/ THERAPY (I), EFFECT (1) 



END OF ARTICLE 
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-DIPHENYL HYDANTOINATE, 

j 



2 ) f ADMINISTRATION (l)t 
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COLLINS VJ 

ADVANCES IN PHARMACOLOGY RELATED TO ANESTHESIA AND SURGERY • 
INDUSTR MED SURG 35,465-71, JLN 66 

NO. OF WORDS * 4594 
(2) BARBITURATES 

Cl) ANT ISPASMCDIC 



BARBITURATES/ THERAPY Cl), ACTIVITY Cl), EFFECT Cl), DOSAGE Cl) 

END OF ARTICLE 
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ERLC 















5o 



COOPER P 

DRUGS FOR CONVULSIVE DISORDERS. 

MIDWIFE HEALTH VISIT 2,212-3, MAY 66 

NO. OF WORDS = 1340 

(3) ANTICONVULSANTS 

50066 (3) 5-ETHYL-5-PHENYLBARB ITURI C ACID, PHENCBARBITAL, B-ARBITURATES 

76948 (1) 5-METHYL-5-PHENYLBAP6ITURIC ACID, BARBITURATES 

125337 (3) PRIMIDONE, 5-PHENYL-5-ETHYLHEXAHYDROPYRIM I CINE-4,6-DI0NE, 
BARBITURATES 

630933 (2) DIPHENYLHYDANTGIN SODIUM, SODIUM 5,5-DIPHENYL HYDANTOINATE, 
HYDANTOINS, GAROIN 

57410 (3) DIPHENYLHYDANTOIN, 5,5-CIPHENYL-2,4-IMIDAZ0LIDINEDI0NE, 
HYDANTOINS 

50124 (2) MEPHENYTOIN, 5— ETHYL-3-METHYL-5-PHENYLHYDANT0IN » HYDANTOINS, 
METHOIN, MESCNTOIN 

127480 (3) TRIMETHADIGNE, 3,5,5-TRIPETHYL-2,4-0XAZ0LlDINEDI0NE, 

OXAZOL IDINEDIONES, TROXICONE, TRIDIONE 

77678 (1) ETHCSUXIMIDE, 2-ETHYL, 2-METHYLSUCCINIMIDE, SUCCINIMIDES 

86340 (1) PHENSUXIMIDE, N-METFYL— 2-PHENYLSUCCINIMIDE, SUCCINIMIOES 

77418 (1) CELONTIN, N,2-DIMETFYL- 2-PHENYLSUCCINIMIDE, SUCCINIMIDES, 
METHSUXIMIDE 

501688 (2) N-BENZYL— BETA-CHLOROPROP ION AM IDE, CHLOROETHYLPHENAMIOE , 
BECLAMIDE 

61563 Cl! TETRAHYDR0-2-P-SULFAMCYL-PHENYL-l,2-THIAZINE-l, 1-DIOXIDE, 
SULTHIAME 

90493 (2) ( 2-PHENYLBUTYRYLJUREA, PHENETURIDE 

63989 ID PHENACEMIDE, PHENYL ACETYLUREA 

298464 (1) CARBAMAZEPINE, TEGRETOL 



ANTICONVULSANTS/ THERAPY Cl), DOSAGE (IS, EFFECT (2), PROPERTIES (1) 
PHENYLMETHYLBARBITURIC ACID/ COSAGE (1) 

BARBITURATES/ DOSAGE (2) 

PHENOBARBITONE/ DOSAGE (2), EFFECT (1) 

PRIMIDONE/ EFFECT (1), DOSAGE (1) 

PHENYTOIN/ DOSAGE (1), THERAPY (1) 

TROXIDONE/ EFFECT 11) 

BECLAMIDE/ EFFECT (1) 






LWJJJ 









5l 



SMITH DLt KEASLING HH, FORIST AA 

THE METABOLISM OF N- ALKY L-4-BR0M0BENZENE SULFONAMIDES IN THE MOUSE. 
CORRELATION WITH ANTICONVULSANT ACTIVITY. 

J MED CHEM 8,520-4, JUL 65 

NO. OF WORDS = 3014 
(3) ANTICONVULSANTS 



ANTICONVULSANTS/ ACTIVITY (3), EFFECT (2), ADMINISTRATION (1), 
THERAPY (II 



END OF ARTICLE 
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52 

SWINYARD EA, CASTELL ION AW 

ANTICONVULSANT PROPERTIES OF SOME BENZQOI AZEPINES. 

J PHARMACOL EXP THER 151*369-75* MAR 66 

NO. OF WORDS = 3339 
(3) ANTICONVULSANTS 

127480 (3) TRIMETHADIONEt 3* 5 ,5-TRI METHYL-2* 4-OXAZOLIDINEDIONE* 

OXAZOL IDINEDIONES 

50066 (1) 5-ETHYL*5— PHENYLBARE ITURI C ACID* PHENCBARBITAL* BARBITURATES 



ANTICONVULSANTS/ PROPERTIES (1>* ACTIVITY (2)* EFFECT (2), EPILEPSY (1) 
TRIMETHADIONE/ ADMINISTRATION (2), COSAGE (l)* ACTIVITY (1) 
PHENOBARBITAL/ ACTIVITY (1) 






mm 






mmm 



■4 



I 

5>3 

BUTLER TCt KUROIWA Y, WADCELL WJ 

EFFECTS OF 5* 5-DIM ETHYL-2* 4-OX AZOL I DINED I ONE CCMO) ON ACID-BASE AND 
ELECTROLYTE ECUILIBRIA. 

J PHARMACOL EXP THER 152*62-6* APR 66 



NO. OF WORDS = 2398 

127480 €31 TRIMETHADIONEt 3 » 5 »5-TRI METHYL-2*4-0XAZ0L IDINEDIONE, 
OXAZOL IDI NEDIONES 



TRIMETHADIONE/ ADMINISTRATION ( 1 ) * EFFECT (1), ACTIVITY (1), DOSAGE (2)» 
EPILEPSY Cl)* THERAPY <1) 



r 












l 
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54 






HUDGINS RLy CCRBIN KB 
AN UNCOMMON SEIZURE DISORCERy 
BRAIN 89 f 199-204y JUN 66 



FAMILIAL PAROXYSMAL CHCREO ATHETOS I S . 



NO. OF WORDS = 2498 

115388 (1) MEPHOBARBITALy 5- E THY L-l~METHYl.-5- PHENYL BARB IT URIC ACICy 
BARBITURATES 



57410 (2) DIPHENYLHYDANTOIN y 5 y5— Cl PHENYL— 2y4-IMI DAZOLIDI NED I ONE y 
HYDANTCINS 



(2) ANTICONVULSANTS 

50066 (1) 5-ETHYL-5— PHENYLBARE ITURI C ACIDy PHENCBARBI TALy BARBITURATES 



ANTICONVULSANTS/ THERAPY (2) 
PHEN0BARB1TAL/ THERAPY (1) 



END CF ARTICLE 
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5>. Output From Reduced Text 
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56 



BERNSTEIN 21 

TREATMENT OF BARBITURATE COMA* 

NEW YORK J PEC 669 2290-4* 1 SEP 66 

NO* OF WORDS * 1C7 

(3) BARBITURATES 



BARBITURATES/ DOSAGE (3) 



END OF ARTICLE 



NEALON TF JR» SUGERMAN H» SHEA W 

AN EXTRACORPOREAL DEVICE TO TREAT BARBITURATE POISONING. 
ANION- EXCHANGE RESINS IN DOGS. 

JAMA 197* 158-160* 11 JUL 66 

NO. OF WORDS * 113 

50066 (3) 5-ETHYL-5-PHENYLBARBITUR IC ACIO* PHENOBARBI TAL # 



PHENCBARB ITAL/ THERAPY (31* DOSAGE (3) 



USE OF 



BARBITURATES 
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57 



LIPP JA 

EPILEPSY. II. BASIC NEURCPHYS IOLOGICAL ASPECTS OF ANTICONVULSANT 
DRUGS. 

APPL THER 8« 437-41, MAY 66 

NO. OF WORDS * 164 

(3) BARBITURATES 

57410 (3) DIPFENYLHYDANTOIN, 5,5-DlPHENYL-2t4-IMI0AZ0LIDINE0ICNE, 
HYSANTOINS 

63989 (3) PHENACEMIDE, PHENYLACETYLUREA 
(3) ANTICONVULSANTS 



BARBITURATES/ ACTIVITY (3) 
CIPFENYLHYCANTOIN/ ACTIVITY (3) 
ANTICONVULSANTS/ ACTIVITY (3) 



END OF ARTICLE 



KLEIN JP 

C I PFENYLFYCANTOIN INTOXICATION ASSOCIATED WITH HYPERGLYCEMIA. 

J PEDIAT 69# 463-5 • SEP 66 

NO. OF WCRDS * 41 

57410 (3) DIPFENYLHYDANTCINt 5. 5-CIPHENYL-2 f 4-IMICAZ0LI0INE0ICNEf 
HYCANTO INS 



C I PHENYLHYCANTO IN/ ADMINISTRATION (3) 



END OF ARTICLE 





£8 



BUCHANAN CS 

AN APPROACH TO MANAGEMENT OF STATUS EPILEPTICUS. 

SOUTHWEST MED 47,187-9, JUL 66 

NO* OF WORDS * 60 

50066 (3) 5-E TH YL- 5-PHENYL BARB I TUR I C ACIOt PHENOBARBITALt BARBITURATES 



PHENOBARBITAL/ THERAPY (3) 



ENO OF ARTICLE 



ARMBRECHT EC, STEERE CW 

A CASE REPORT OF EVALUATION AND MANAGEMENT OF HYPERPLASTIC GINGIVA IN 
EPILEPTICS CAUSED BY SODIUM CILANTIN THERAPY. 

W VIRGINIA DENT J 40,43-4, JUL 66 

NO. OF WORDS - 115 

57410 (3) DIPHENYLHYDANTOIN, 5,5-0IPHENYL-2,4-IMI0AZCLlDINE0IGNE, 
HYDANTOINS, CILANTIN 

630933 (3) C I PHENYLHYCANTO IN SODIUM, SGCIUM 5,5-DIPHENYL HYOANTOINATE , 
HYCANTOINS, CILANTIN SODIUM 



CILANTIN/ THERAPY (3) 



END 



OF ARTICLE 



CCUGLAS A« SIWPSCN 0, NERCHANT S 

THE EFFECT CF ANT ISPASMGDIC DRUGS ON THE ENDOWURAL BRONCHIAL (OR 
SQUEEZE) PRESSURES IN BRONCHITIS ANC ASTHHA* 

AWER REV RESP CIS 93 f 703-15t WAY 66 

NO* OF WORCS ■ 85 

(3) ANT I SPASWCD IC 



ANTISPA SWCCIC/ ACW INI STRAT ION (3) 



END OF ARTICLE 



GILBERT JCy ORTIZ WRy MILL ICHAP JG 

THE EFFECTS OF ANTICONVULSANT DRUGS ON THE PERWEAB I LI TY OF BRAIN 
CELLS TO D-XYLOSE • 

J NEURCCHEW 13y247-55y APR 66 

NO* OF WORDS = 149 

5CC66 (3) 5-ETHYL- 5-PHENYL BARB I TUR IC ACIOy PHENOBARB I TAL* BARBITURATES 

695534 (3) Cl WETFACIONE * 5y5-CIMETHYLCXAZCLIDINE-2y4-CI0NEy 
CXAZGLIC I NED I ONES 

57410 (3) DIPHENYLHYDANTOINy 5y 5-CIPHENYL-2y4-IMIDAZGLIDINE0I0NEy 
HYDANTOINS 

(3) ANTICONVULSANTS 



C I PHENYLHYDANTO IN/ EFFECT (3) 
ANTICONVULSANTS/ EFFECT (3) 



END OF ARTICLE 









60 




CHINITZ A» SEELINGER DF« GREENHOUSE AH 

ANT ICCNVULSANT THERAPY IN TRIGEMINAL NEURALGIA 

AMER J NEC SCI 252,62-7 f JUL 66 



NO. OF WORDS = 101 

630933 (3) DIPHENYLHYCANTOIN SODIUM* SODIUM 5« 
HYDANTCINS 



57410 (3) OIPHENYLHYDANTOIN* 5, 5-0 IPHENYL-2 *4- 
HYCANTC INSt DILANTIN 



(3) ANTICONVULSANTS 



298464 (3) CARBAMAZEPINE* TEGRETOL 



TEGRETOL/ EFFECT (3) 

DIPHENYLHYCANTOIN SODIUM/ THERAPY 13) 
CARBAMAZEPINE/ THERAPY (3) 



END OF ARTICLE 






I: 



COLLINS VJ 

ADVANCES IN PHARMACOLOGY RELATED TO ANESTHES 
INCUSTR MED SURG 35*465-71* JUN 66 



IA 



NO. 



OF WORDS 



117 



END OF 



ARTICLE 
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5—0 I PHENYL HYDANTOINATE, 
IHIDAZCLt DINEDIONEt 







61 



COOPER P 

DRUGS FOR CONVULSIVE DISORDERS. ~ 

MIDWIFE HEALTH VISIT 2*212-3* HAY 66 

NO. OF WORDS * 122 

(3) ANTICONVULSANTS 

50066 (3) 5-ETHYL-5-PHENYLBARBITURIC ACID* PHENOBARBI TAL* BARBITURATES 

115388 (3) MEPHGBARBI TAL * 5-ETHYL- i-METH YL-5-PHENYL BARB I TUR I C ACID* 
BARBITURATES* PROP INAL 

76948 (3) 5-METHYL-5-PHENYLBARBITURIC ACID* BARBITURATES* RUTONAL 

125337 (3) PRIMIDONE* 5-PHENYL-5-ETHYLHEXAHY0R0PYRIMICINE-4.6-DI0NE* 
BARBITURATES. PYSCLINE 

630933 (3) D I PHENYLHYDANTOIN SODIUM* SOCIUM 5.5-DIPHENYL HYOANTOINATE * 
HYCANTOINS* EPANUTIN 

50124 (3) MEPHENYTCIN* 5-ETHYL-3-METHYL-5-PHENYLHYCANT0IN* HYOANTOINS* 
PETHCIN* MESCNTC IN 

MX-8028679 (3) HYCANTOINS* BARBITURATES* HYDANTAL 

127480 (3) TRIMETHADICNE. 3* 5.5-TRIMETHYL-2 .4-CXAZCLICINEDIONE* 

OXAZOL ID INED ICNES * TROXIDCNE* TRIDIONE 

77678 (3) ETHOSUXIMIDE* 2-ETHYL .2-METHYLSUCC IN IM IDE* SUCCINIMIDES 

86340 (3) PHENSUXIPIDE* N-PETHYL-2-PHENYLSUCCINIPIDE* SUCCINIMIDES* 
MILONTIN 

77418 (3) CELCNTIN* N.2-DIPETHYL-2-PHENYLSUCCINIMICE* SUCCINIMIDES* 
PETHSUXIPICE 

501688 (3) N- BENZYL-BET A-CHLORCPROP IONAMIDE * CHLORCETHYLPHENAMIDE, 
BECLAPIDE. NYDRANE 

61563 ( 3 > TETRAHYDRO-2-P-SULFAMOYL-PHENYL-l *2-THI AZ INE-1 * 1-DIOXIDE* 
SULTHIAME* OSPOLCT 

90493 (3) ( 2-PHENYL BUT YRYL ) UREA* PHENETUR IDE 

298464 (3) CARBAP AZEP INE * TEGRETOL 



RUTONAL/ DOSAGE (3) 
ANTICONVULSANTS/ EFFECT (3) 
PHENYTC IN SODIUM/ THERAPY (3) 



END OF ARTICLE 



62 



SMITH CL, KEASLING HH, FORIST AA 

THE METABOLISM OF N-ALKYL-4-BROMOBENZENE SULFONAMIDES IN THE MOUSE* 
CORRELATION WITH ANTICONVULSANT ACTIVITY* 

J MED CHEM 8,520-4 , JUL 65 

NO* OF WORDS = 132 

(3) ANTICONVULSANTS 



ANTICONVULSANTS/ ACTIVITY C3) 



END OF ARTICLE 



SWINYARC EA, CASTELL ION AW 

ANTICONVULSANT PROPERTIES OF SOME BENZOC I AZEP INES* 
J PHARMACOL EXP THER 151,369-75, MAR 6 ^ 1AZEPINES * 



NO. OF WORDS = 396 

(3) ANTICONVULSANTS 



127480 (3) TRIMETFADICNE, 
OXAZOLID INED I ONES 



3, 5,5-TR IMETHYL-2,4-0XAZCLI DINEOIONE, 



TRIMETHACIONE/ ADMINISTRATION (3) 
ANTICONVULSANTS/ ACTIVITY (2) 



END OF 



article 



63 



BUTLER TC* KURGIHA Y f MAOCELL WJ 

EFFECTS CF 5*5-CIMETHYL-2 f 4-0XAZ0L ICINECICNE < CMC ) ON ACID-BASE AND 
ELECTROLYTE EQUILIBRIA. 

J PHARMACOL EXP THER 152t62-6» APR 66 

NO. OF MCROS = 152 

127480 (3) TRIMETHADIONE* 3t5 »5-TR IMETHYL-2 .4-OXAZCLI OINEOIONE* 
CXAZ0LI0INEC1CNES 



TRIMETHACICNE/ ADMINISTRATION (3) 



END CF ARTICLE 



HUCGINS RLt CCRBIN KB 
AN UNCOMMON SEIZURE DISORCERt 
BRAIN 89t 199—204 « JUN 66 



FAMILIAL PAROXYSMAL CHCREOATHETOSl S. 



NO* CF MORCS - 52 

(3) ANTICONVULSANTS 



ANTICONVULSANTS/ THERAPY (3) 



END OF ARTICLE 
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